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WHAT IS CLAIMED IS: 

1 LA method for routing packets in a router, the method comprising: 

2 receiving a plurality of packets in a first order; 

3 storing said plurality of packets in a packet reorder buffer; and 

4 forwarding said plurality of packets in a second order from said packet reorder 

5 buffer. 

1 2. The method of claim 1 , further comprising: 

2 determining a plurality of hash values using information contained in said 

3 plurality of packets; 

4 storing said plurality of hash values in said packet reorder buffer; and 

5 using said plurality of hash values to determine said second order. 

1 3. The method of claim 2, wherein a first subset of said plurality of 

2 packets having a common hash value is forwarded in an order in which said first 

3 subset is received by said router. 

1 4. The method of claim 2, wherein said hash value is determined using a 

2 destination address of said plurality of packets. 

1 5. The method of claim 2, wherein said hash value is determined using a 

2 source address of said plurality of packets. 

1 6. The method of claim 2, wherein said hash value is determined using a 

2 protocol used by said plurality of packet. 
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7. The method of claim 2, wherein said hash value is determined using an 
address of at least one incoming port used by said plurality of packets. 

8. The method of claim 2, wherein said hash value is determined using an 
address of at least one outgoing port used by said plurality of packets. 

9. The method of claim 2, further comprising: 

setting a status of said plurality of packets in said packet reorder buffer to 
'not-ready \ 

10. The method of claim 8, further comprising: 

selecting a 'head of line' packet from said packet reorder buffer, said 'head of 
line' packet is a packet that is stored in said packet reorder buffer for 
longest period of time; and 

identifying said 'head of line' packet using a 'head of line' pointer. 

1 1 . The method of claim 1 0, wherein said 'head of line' pointer is a 
software based pointer. 

12. The method of claim 10, wherein said 'head of line' pointer is a 
hardware-based pointer. 

13. The method of claim 10, further comprising: 

locating a routing information for said plurality of packets in a cache; 
if said routing information is not located in said cache, 

locating said routing information in a lookup table; and 
when said routing information is located, setting said status of said plurality of 

packets in said packet reorder buffer to 'ready'. 

14. The method of claim 13, further comprising: 

selecting a first packet with a 'ready' status from said packet reorder buffer; 
determining whether said first packet is 'head of line' packet. 
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1 15. The method of claim 14, further comprising: 

2 if said first packet is 'head of line' packet, 

3 removing said first packet from said packet reorder buffer, 

4 forwarding said first packet, and 

5 if said packet reorder buffer is not empty, 

6 moving said 'head of line' pointer to one of said plurality of 

7 packets that is stored for longest period of time in said 

8 packet reorder buffer. 



1 ;; 



1 1 6. The method of claim 1 5, further comprising: 

2 if said first packet is not said 'head of line' packet, 

3 locating said 'head of line' packet in said packet reorder buffer, 

4 determining whether said first packet and said 'head of line' packet 

5 have a common hash value, and 

6 if said first packet and said 'head of line' packet have a common hash 

7 value, 

8 selecting a second packet with a 'ready' status from said packet 

9 reorder buffer. 

1 17. The method of claim 1 6, further comprising: 

2 if said first packet and said 'head of line' packet do not have a common hash 

3 value, 

4 identifying a second subset of said plurality of packets having a 

5 common hash value with said first packet from said packet 

6 reorder buffer, 

7 determining whether said first packet is stored for longest period of 

8 time in said packet reorder buffer among said second subset of 

9 said plurality of packets, and 

1 0 if said first packet is not stored for longest period of time in said packet 

1 1 reorder buffer among said second subset of said plurality of 

12 packets, 

1 3 selecting a third packet with a 'ready' status from said packet 

1 4 reorder buffer. 
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1 18. The method of claim 17, further comprising: 

2 if said first packet is stored for longest period of time among said second 

3 subset of said plurality of packets in said packet reorder buffer, 

4 determining whether a predetermined number of packets have been 

5 forwarded ahead of said 'head of line' packet from said packet 

6 reorder buffer. 

1 1 9. The method of claim 1 8, further comprising: 

2 if a predetermined number of packets have not been forwarded ahead of said 

3 'head of line' packet from said packet reorder buffer, 
I s * 4 forwarding said first packet. 

W 1 20. The method of claim 1 9, further comprising: 

p 2 if said predetermined number of packets have been forwarded ahead of said 

3 'head of line' packet from said packet reorder buffer, 

s 4 generating an error, and 

5 waiting until said 'head of line' packet is forwarded. 

1 21 . The method of claim 1 8, wherein said predetermined threshold is 

2 defined during a provisioning of said router. 

1 22. The method of claim 1 8, wherein said predetermined threshold is 

2 dynamically calculated by said router. 

1 23. The method of claim 20, wherein said head-of-line packet is forwarded 

2 before said routing information for said 'head of line' packet is located. 

1 24. A packet reordering system comprising: 

2 a packet reorder buffer; and 

3 a 'head-of-line' pointer. 
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1 25. A network element comprising the packet reordering system of claim 

2 24, further comprising: 

3 a packet receiving unit coupled to said packet reordering system, said packet 

4 receiving unit is configured to receive a plurality of packets. 

1 26. The network element of claim 25, further comprising: 

2 a packet forwarding unit coupled to said packet reordering system, said packet 

3 forwarding unit is configured to forward said plurality of packets. 

1 27. The network element of claim 26, further comprising: 

2 a processor coupled to said packet reordering system, said processor 

3 configured to 

4 determine a plurality of hash values using information contained in 

5 said plurality of packets, and 

6 store said plurality of hash values and said plurality of packets in said 

7 packet reorder buffer. 

1 28. The network element of claim 27, further comprising: 

2 a network interface coupled to said processor. 

1 29. The network element of claim 28, wherein said network interface 

2 comprising said packet receiving and said packet forwarding units. 

1 30. The network element of claim 27, further comprising: 

2 a memory coupled to said processor, said memory stores a lookup table. 

1 31. The network element of claim 28, further comprising: 

2 a cache coupled to said processor. 
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1 32. A network element comprising: 

2 a processor; said processor is configured to 

3 receive a plurality of incoming packets in a first order; 

4 separate said plurality of incoming packets into a plurality of subsets of 

5 incoming packets; 

6 forward said plurality of subsets of incoming packets in a second order. 

1 33. The network element of claim 32, wherein said plurality of incoming 

2 packets is separated according to a plurality of characteristics of said plurality of 

3 incoming packets. 

M 1 34. The network element of claim 32, wherein incoming packets in each 

m 2 one of said plurality of subsets of incoming packets are forwarded in an order that the 

y J 3 incoming packets are received. 

^ J 1 35. The network element of claim 3 3 , wherein one of said plurality of 

s 2 characteristics is a destination address of said plurality of incoming packets. 

fU 1 36. The network element of claim 33, wherein one of said plurality of 

f i 2 characteristics is a source address of said plurality of incoming packets. 

(** 

1 37. The network element of claim 33, wherein one of said plurality of 

2 characteristics is a protocol used by said plurality of incoming packets. 

1 38. The network element of claim 33, wherein one of said plurality of 

2 characteristics is an address of at least one incoming port used by said plurality of 

3 incoming packets. 

1 39. The network element of claim 33, wherein one of said plurality of 

2 characteristics is an address of at least one outgoing port used by said plurality of 

3 incoming packets. 
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1 


40. 


A network element for routing packets in a router comprising: 


2 


means 


for receiving a plurality of packets in a first order; 


3 


means 


for storing said plurality of packets in a packet reorder buffer; and 


4 


means 


for forwarding said plurality of packets in a second order from said 


5 




packet reorder buffer. 



1 41. The network element of claim 4 1 , further comprising: 

2 " means for determining a plurality of hash values using information contained 

3 in said plurality of packets; 

4 means for storing said plurality of hash values in said packet reorder buffer; 

5 and 

H; , 6 means for using said plurality of hash values to determine said second order. 

^ 1 42. The network element of claim 4 1 , wherein a first subset of said 

01 2 plurality of packets having a common hash value is forwarded in an order in which 

3 said first subset is received by said router. 

nil 43 . The network element of claim 4 1 , wherein said hash value is 

[ h i 2 determined using a destination address of said plurality of packets. 

1 44. The network element of claim 41 , wherein said hash value is 

2 determined using a source address of said plurality of packets. 

1 45. The network element of claim 41 , wherein said hash value is 

2 determined using a protocol used by said plurality of packet. 

1 46. The network element of claim 41 , wherein said hash value is 

2 determined using an address of at least one incoming port used by said plurality of 

3 packets. 

1 47. The network element of claim 41 , wherein said hash value is 

2 determined using an address of at least one outgoing port used by said plurality of 

3 packets. 
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1 48. The network element of claim 4 1 , further comprising: 

2 means for setting a status of said plurality of packets in said packet reorder 

3 buffer to 'not-ready' . 

1 49. The network element of claim 47, further comprising: 

2 means for selecting a 'head of line' packet from said packet reorder buffer, 

3 said 'head of line' packet is a packet that is stored in said packet 

4 reorder buffer for longest period of time; and 

5 means for identifying said 'head of line' packet using a 'head of line' pointer. 

M 1 50. The network element of claim 49, wherein said 'head of line' pointer is 
y 2 a software based pointer. 

t 1 51. The network element of claim 49, wherein said 'head of line' pointer is 
O 2 a hardware-based pointer. 

^ 1 52. The network element of claim 49, further comprising: 

r J 2 means for locating a routing information for said plurality of packets in a 

*2 3 cache; 

H- 4 means for locating said routing information in a lookup table if said routing 

5 information is not located in said cache; and 

6 means for setting said status of said plurality of packets in said packet reorder 

7 buffer to 'ready' when said routing information is located. 

1 53 . The network element of claim 52, further comprising: 

2 means for selecting a first packet with a 'ready' status from said packet 

3 reorder buffer; 

4 means for determining whether said first packet is 'head of line' packet. 
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1 54. The network element of claim 53, further comprising: 

2 means for removing said first packet from said packet reorder buffer if said 

3 first packet is 'head of line' packet; 

4 means for forwarding said first packet if said first packet is 4 head of line' 

5 packet if said first packet is 'head of line' packet; and 

6 means for moving said 'head of line' pointer to one of said plurality of 

7 packets that is stored for longest period of time in said packet reorder 

8 buffer if said packet reorder buffer is not empty, 

1 55. The network element of claim 54, further comprising: 

2 means for locating said 'head of line' packet in said packet reorder buffer if 

3 said first packet is not said 'head of line' packet; 

4 means for determining whether said first packet and said 'head of line' packet 

5 have a common hash value if said first packet is not said 'head of line' 

6 packet; and 

7 means for selecting a second packet with a 'ready' status from said packet 

8 reorder buffer if said first packet and said 'head of line' packet have a 

9 common hash value. 

1 56. The network element of claim 55, further comprising: 

2 means for identifying a second subset of said plurality of packets having a 

3 common hash value with said first packet from said packet reorder 

4 buffer if said first packet and said 'head of line' packet do not have a 

5 common hash value; 

6 means for determining whether said first packet is stored for longest period of 

7 time in said packet reorder buffer among said second subset of said 

8 plurality of packets if said first packet and said 'head of line' packet do 

9 not have a common hash value; and 

1 0 means for selecting a third packet with a 'ready' status from said packet 

1 1 reorder buffer if said first packet is not stored for longest period of 

1 2 time in said packet reorder buffer among said second subset of said 

1 3 plurality of packets. 
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1 57. The network element of claim 56, further comprising: 

2 means for determining whether a predetermined number of packets have been 

3 forwarded ahead of said 'head of line' packet from said packet reorder 

4 buffer if said first packet is stored for longest period of time among 

5 said second subset of said plurality of packets in said packet reorder 

6 buffer. 

1 58. The network element of claim 57, further comprising: 

2 means for means for forwarding said first packet if a predetermined number of 

3 packets have not been forwarded ahead of said 'head of line' packet 

4 from said packet reorder buffer. 

D 1 59. The network element of claim 58, further comprising: 

2 means for generating an error if said predetermined number of packets have 
^* 3 been forwarded ahead of said 'head of line' packet from said packet 

M-3 4 reorder buffer, and 

5 means for waiting until said 'head of line' packet is forwarded if said 

6 predetermined number of packets have been forwarded ahead of said 

7 'head of line' packet from said packet reorder buffer. 

1 60. The network element of claim 57, wherein said predetermined 

2 threshold is defined during a provisioning of said router. 

1 61 . The network element of claim 57, wherein said predetermined 

2 threshold is dynamically calculated by said router. 

1 62. A computer program for forwarding a packet in a network, encoded in 

2 computer readable media, said program product comprising a set of instructions 

3 executable on a computer system, wherein said set of instructions is configured to 

4 receive a plurality of packets in a first order; 

5 store said plurality of packets in a packet reorder buffer; and 

6 forward said plurality of packets in a second order from said packet reorder 

7 buffer. 
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1 63. The computer program product of claim 62, wherein said set of 

2 instructions is further configured to: 

3 determine a plurality of hash values using information contained in said 

4 plurality of packets; 

5 store said plurality of hash values in said packet reorder buffer; and 

6 use said plurality of hash values to determine said second order. 

1 64. The computer program product of claim 63 , wherein a first subset of 

2 said plurality of packets having a common hash value is forwarded in an order in 

3 which said first subset is received by said router. 

1 65. The computer program product of claim 63, wherein said hash value is 

2 determined using a destination address of said plurality of packets. 

1 66. The computer program product of claim 63, wherein said hash value is 

2 determined using a source address of said plurality of packets. 

1 67. The computer program product of claim 63, wherein said hash value is 

2 determined using a protocol used by said plurality of packet. 

1 68. The computer program product of claim 63, wherein said hash value is 

2 determined using an address of at least one incoming port used by said plurality of 

3 packets. 

1 69. The computer program product of claim 63, wherein said hash value is 

2 determined using an address of at least one outgoing port used by said plurality of 

3 packets. 

1 70. The computer program product of claim 63, wherein said set of 

2 instructions is further configured to 

3 set a status of said plurality of packets in said packet reorder buffer to 'not- 

4 ready'. 
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1 71 . The computer program product of claim 69, wherein said set of 

2 instructions is further configured to 

3 select a 'head of line' packet from said packet reorder buffer, said 'head of 

4 line' packet is a packet that is stored in said packet reorder buffer for 

5 longest period of time; and 

6 identify said 'head of line 5 packet using a 'head of line' pointer. 

1 72. The computer program product of claim 7 1 , wherein said 'head of line' 

2 pointer is a software based pointer. 

1 73 . The computer program product of claim 7 1 , wherein said 'head of line' 

2 pointer is a hardware-based pointer. 

1 74. The computer program product of claim 7 1 , wherein said set of 

2 instructions is further configured to: 

3 locate a routing information for said plurality of packets in a cache; 

4 if said routing information is not located in said cache, 

5 locate said routing information in a lookup table; and 

6 when said routing information is located, set said status of said plurality of 

7 packets in said packet reorder buffer to 'ready' . 

1 75. The computer program product of claim 74, wherein said set of 

2 instructions is further configured to 

3 select a first packet with a 'ready' status from said packet reorder buffer; 

4 determine whether said first packet is 'head of line' packet. 

1 76. The computer program product of claim 75, wherein said set of 

2 instructions is further configured to: 

3 if said first packet is 'head of line' packet, 

4 remove said first packet from said packet reorder buffer, 

5 forward said first packet, and 

6 if said packet reorder buffer is not empty, 
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7 move said 'head of line' pointer to one of said plurality of 

8 packets that is stored for longest period of time in said 

9 packet reorder buffer. 

1 77. The computer program product of claim 76, wherein said set of 

2 instructions is further configured to: 

3 if said first packet is not said 'head of line' packet, 

4 locate said 'head of line' packet in said packet reorder buffer, 

5 determine whether said first packet and said 'head of line' packet have 

6 a common hash value, and 

7 if said first packet and said 'head of line' packet have a common hash 

8 value, 

9 select a second packet with a 'ready' status from said packet 

10 reorder buffer. 



1 78. The computer program product of claim 77, wherein said set of 
: 2 instructions is further configured to 

f] i 3 if said first packet and said 'head of line' packet do not have a common hash 

[1 4 value, 

O 5 identify a second subset of said plurality of packets having a common 

6 hash value with said first packet from said packet reorder 

7 buffer, 

8 determine whether said first packet is stored for longest period of time 

9 in said packet reorder buffer among said second subset of said 

1 0 plurality of packets, and 

1 1 if said first packet is not stored for longest period of time in said packet 

1 2 reorder buffer among said second subset of said plurality of 

13 packets, 

14 select a third packet with a 'ready' status from said packet 

15 reorder buffer. 
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1 79. The computer program product of claim 78, wherein said set of 

2 instructions is further configured to 

3 if said first packet is stored for longest period of time among said second 

4 subset of said plurality of packets in said packet reorder buffer, 

5 determine whether a predetermined number of packets have been 

6 forwarded ahead of said 'head of line' packet from said packet 

7 reorder buffer. 

1 80. The computer program product of claim 79, wherein said set of 

2 instructions is further configured to: 

3 if a predetermined number of packets have not been forwarded ahead of said 

4 'head of line' packet from said packet reorder buffer, 

5 forward said first packet. 

1 81. The computer program product of claim 80, wherein said set of 

2 instructions is further configured to 

3 if said predetermined number of packets have been forwarded ahead of said 

4 'head of line' packet from said packet reorder buffer, 

5 generate an error, and 

6 wait until said 'head of line' packet is forwarded. 

1 82. The computer program product of claim 79, wherein said 

2 predetermined threshold is defined during a provisioning of said router. 

1 83. The computer program product of claim 79, wherein said 

2 predetermined threshold is dynamically calculated by said router. 
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